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IMAGE PROCESSING DEVICE AND METHOD 

BACKGROUND QF THE INVENTION 
Field of the Inventiion 

5 This invention relates to an image processing device 

and method. 

Related Backgrounci Art 

Conventional image processing devices are configured to 
output the result of analysis each time after execution of a 

10 unit of jobs on an image, namely, acquiring image data on 
the single image from a camera, processing and inspecting 
the acquired image data. 

Therefore, as shown in Fig. 1 for example, in case an 
object of a large size needs inspection of some portions 

15 thereof discrete over a region beyond the coverage by the 

field of view of a single camera, it is necessary to use two 
or more cameras CI, C2 to acquire image data of such 
portions to be examined from respective cameras. 

However, since any image processing device has only a 

20 limited number of connectors for cameras, image processing 
devices of this type cannot cope with inspection of objects 
requiring more cameras than the maximum number connectable 
to a single image processing device. 

This inconvenience is overcome if relative movement is 

25 possible between one or more cameras and an object to be 

examined as shown in Fig. 2, for example, in which a single 
camera CI is shown as being moved from one portion to 
another. In this case, the image processing device can 
sequentially acquire and inspect images of different 

30 positions of the object from the camera or cameras in 



response to triggers generated inside or introduced from 
outside in predetermined time intervals. 

Both these methods, however, cannot treat results of 
inspection obtained by a plurality of times of inspection of 
5 a single object or a plurality of identical objects to 

collectively estimate the entire acceptability, quality, etc. 
of the object or identical objects. 

.qiTMMARY OF THE INVENTION 
10 It is therefore an object of the invention to provide 

an image processing device and an image processing method 
capable of collectively estimating an object based upon a 
plurality of times of inspection. 

A further object of the invention is to provide an 
15 image processing device and an image processing method 

capable of collectively estimating a large-sized object not 
covered by the field of view of a camera. 

A still further object of the invention is to provide 
an image processing device and an image processing method 
20 capable of collectively estimating a plurality of identical 
obj ects - 

In order to achieve the above objects, the invention is 
characterized in executing collective estimation after 
completing a plurality of times of acquisition of image data 
25 from a camera and a plurality of times of image processing 
of individual pieces of image data. 

One camera or a plurality of cameras may be used to 
obtain image data on a plurality of portions of one or more 
objects to be examined. 
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BRTRF DESCRIPTION OF THE DRAWINGS 
Fig. 1 is a diagram for explaining a conventional 
method of inspection of a relatively large-sized object; 

Fig. 2 is a diagram for explaining another conventional 
5 method capable of overcoming a disadvantage of the 

conventional method shown in Fig. 1 in case of inspection of 
a relatively large-sized object; 

Fig. 3 is a timing chart for explaining procedures in 
an embodiment of the invention; 
10 Fig. 4 is a diagram for explaining an example of 

registration of a user's optional setting according to an 
embodiment of the invention; 

Fig. 5 is a diagram for explaining that an embodiment 
of the invention is effective for collective estimation of a 
15 plurality of identical objects; 

Fig. 6 is a diagram for explaining that an embodiment 
of the invention is effective for collective estimation of a 
relatively large-sized object by different kinds of 
inspection of different portions of the object; 
20 Fig. 7 is a diagram for explaining that an embodiment 

of the invention is effective when applied to collective 
estimation of an elongate object; 

Fig. 8 is a diagram for explaining that an embodiment 
of the invention is effective for measuring the sum of 
25 lengths xl, x2 of projections extending in the x-direction 
at opposite ends of an object; 

Fig. 9 is a diagram for explaining procedures of 
operation of an image processing device according to an 
embodiment of the invention for inspection of the object 
30 shown in Fig. 8; 



Figs. lOA and lOB are diagrams for explaining a process 
for finding lengths of projections at opposite ends of the 
object shown in Fig. 8; and 

Fig. 11 is a flowchart for explaining procedures of 
operation of the image processing device according to the 
same embodiment. 

DETAILED DERCRIPT TON OF THE INVENTION 
Fig. 3 is a timing chart showing procedures of 
photographing an object twice with a single camera in a 
method according to an embodiment of the invention. In Fig. 
3, TRG shows the timing of inputting triggers, BUSY shows 
the timing of a unit of jobs in a single inspection task on 
a set of images of one or more objects, BUSY2 shows the 
timing of acquiring image data, and STB shows the timing of 
outputting a result of collective estimation. The camera is 
driven to obtain the first image in response to the first 
trigger at the timing shown by TRG. Responsively , an image 
processing device acquires image data of the first image 
from the camera at the timing shown by BUSY2 and carries out 
inspection including arithmetical operation of the data 
values. Thereafter, the camera and/or the object are moved 
to the next relative position, and the camera is driven to 
obtain the second image in response to the second trigger at 
the timing shown by TRG. Responsively, the image processing 
device acquires the image data of the second image from the 
camera at the timing shown by BUSY2 and carries out 
inspection including arithmetical operation of the data 
values. After completion of the inspection of the second 
image data, the image processing device carries out 




collective estimation of the object, based upon the result 
of the first inspection and the result of the second 
inspection, and outputs the result of the collective 
estimation to a display of the image processing device or an 
5 external device at the timing shown by STB. Thereafter, the 
image processing device erases the first and second image 
data, related data values, and so on. In case two cameras 
are prepared and connected to the image processing device, 
the first camera may be used to obtain the first image, and 
10 the second camera may be used to obtain the second image. 

It is desirable to permit users to set any desired 
number of shots by the camera, i.e. the number of triggers 
for the camera to obtain images. Additionally, it is 
preferable to permit a user to set any kinds of inspection 
15 groups combining conditions or contents of inspection 

beforehand, and to assign any desired inspection group to a 
particular trigger number. For example, an inspection group 
GRl may be assigned to an n-th trigger, and the same 
inspection group GRl or different inspection group GR2, for 
20 example, may be assigned to the next trigger number. 

Examples of the conditions or contents of inspection include 
positions of an object or objects to be examined. That is, 
the term "inspection group" herein means a combination of 
inspection items for a single target image. The term 
25 "inspection (measurement)" means a kind of designated 

inspection or a set of designated kinds of inspection to be 
executed on a pattern formed by one or more windows set on 
each target image. Fig. 4 shows an example of registration 
of such user's optional setting. In Fig. 4, if the number of 
30 triggers is 3, inspection of the first group GRl is executed 
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in response to the first trigger; inspection of the second 
group GR2 is executed in response to the second trigger; and 
inspection of the third group GR3 is executed in response to 
the third trigger. 
5 Fig. 5 shows a rather concrete example of inspection. 

Here is carried out identical inspection of a plurality of 
identical objects w, which may be products of a common lot, 
each having a size fully covered by the field of view of a 
camera. In this example, six identical objects wl through w6 

10 are shown. After inspection of the final one of these 

objects, results of six times of inspection are collectively 
estimated, and a result of the collective estimation of all 
objects is output. In Fig. 5, reference numeral 1 denotes a 
target image. In the example of Fig. 5, if these steps and 

15 contents of inspection are registered by user's choice 

similarly to the user's optional setting of Fig. 4, then the 
number of triggers is 6, and one inspection group is 
assigned to all trigger numbers. Thus, all these identical 
objects wl through w6 shown in Fig. 5 are examined by 

20 identical inspection, and are collectively estimated from 
results of six times of identical inspection. 

Fig. 6 shows another example of inspection. Here is 
carried out different kinds of inspection of a relatively 
large-sized single object w having a plurality of portions 

25 to be examined, which are not covered entirely by the field 
of view of a camera. Different target images 1(1) through 
1(6) of the object w are prepared, and corresponding image 
data undergo different items of inspection. After the 
inspection of image data on the target image 1(6) to be 

30 finally inspected, a result of collective estimation of the 




object w is output. If these steps and contents of 
inspection are registered by user's choice similarly to the 
user's optional setting of Fig. 4, the number of triggers is 
6, and different inspection groups are assigned to the 
5 respective trigger numbers. Thus, the object can be examined 
by different kinds of inspection, and can be collectively 
estimated from results of six times of different kinds of 
inspection. 

Fig. 7 shows another example of inspection. Here is 

10 taken an elongate single object w like a cable having a 

plurality of portions to be examined, which are not covered 
entirely by the field of view of a camera. The elongate 
object w is photographed a plurality of times while it moves 
aside a stationary camera. After inspection of a portion of 

15 the object w to be finally inspected for example, a result 
of collective estimation of the elongate object w is output. 
If these steps and contents of inspection are registered by 
user's choice similarly to the user's optional setting of 
Fig. 4, one inspection group (identical inspection) is 

20 assigned to respective trigger numbers of the triggers 

determined by the user. Thus, a plurality of timed of the 
inspection and the collective estimation can be carried out 
as explained above. 

Next referring to Figs. 8 through 11, inspection or 

25 measurement by internal processing of an image processing 
device according to an embodiment will be explained below. 
Here is shown a process for finding the sum of lengths xl, 
x2 of projections extending at opposite ends of a relatively 
long object w shown in Fig. 8, and outputting its result. 

30 As shown in Fig. 9, target images 1(1) and 1(2) of 




opposite end portions of the object w are prepared. A single 
camera may be used for obtaining required images of the 
object w, and either the camera or the object w may be moved 
to required relative positions. 
5 In response to a first trigger, the camera is driven to 

obtain a first image of the left end portion of the object w 
including the left projection, which is the first target 
image 1(1). Responsively, the image processing device 
acquires image data of the first target image. Thereafter, 

10 the image processing device measures the length xl of the 

left projection extending in the x-direction at the left end 
of the object w as shown in Fig. lOA. In the next process, 
the camera is driven by a second trigger to capture a second 
image of the right end portion of the object w including the 

15 right projection, which is the second target image 1(2). 
Responsively, the image processing device acquires image 
data of the second image data 1(2). Thereafter, the image 
processing device measures the length x2 of the right 
projection extending in the x-direction at the right end of 

20 the object w as shown in Fig. lOB. After that, the image 
processing device totals xl and x2 and obtains the value 
{xl+x2) inside. 

With reference to Fig. 11, procedures of operation of 
the image processing device are explained in greater detail. 

25 In step SI, a user registers the optional setting of a 

necessary number of shots by the camera (number of triggers) 
and other required conditions for inspection, as already 
explained with reference to Fig. 4. That is, the user 
registers "2" as the number of triggers; assigns "GRl" to 

30 the first trigger and "GR2" to the second trigger; and 



designates "Inspection 1 + Inspection 2" as the arithmetical 
operation. 

In the next step S2, the object w or the camera is 
moved to a predetermined relative position to focus the 
camera onto the left end portion of the object 2. In the 
next step S3, the camera captures the first image of the 
left end portion of the object w, and the image processing 
device acquires image data of the first image. In the next 
step S4, the image processing device measures the length xl 
of the left projection of the object w. In the next step 5, 
the device confirms whether the number of triggers has 
reached 2 or not, and returns to step 32 because the number 
of triggers is still 1. Thereafter, the steps S2 to S4 are 
repeated to establish relative positional relation between 
the object 2 and the camera for focusing the camera onto the 
right end portion of the object 2; drive the camera to 
capture the second image of the right end portion of the 
work; acquire the image data of the second target image from 
the camera; and measures the length X2 of the right 
projection of the object w. 

After completion of the second measurement, the image 
processing device proceeds to the step S5 and further to the 
step S6, and calculates the final output value (Out) by 
addition of the lengths xl and x2 . Additionally, it compares 
the final output (Out) with a predetermined allowance 
(having the upper limit Max (Out) and the lower limit of 
Min (Out) ) . 

That is, if the final output value satisfies 
Min(0ut)<0ut< lyiax(Out), the image processing device estimates 
that the object w is acceptable, and if the final output 
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(Out) is not within the allowance, that is, if Out<Min(Out) 
or Max (Out ) <Out , it estimates that the object w is not 
acceptable. After the estimation, the device outputs a 
result of estimation to a display of the device itself or an 
external device in step S8. 



